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Command 


Desertion 


connect 


ConilBF a virtual console session to an SRNWrmware instance 


disconnect 


Disconnect a virtual console session from an SRM Firmware 
instance 


power {off, on} 
item 


Change the power state of an item (CPU, 8P unit, I/O Drawer) 


halt processor 


Issue a HALT to an EV7 processor (specified by processor ID) 


reset [partition] 


Issue a system reset or a reset to the specified partition 


reset processor 


Issue a Reset to an EV7 processor (specified by processor ID) 


reset { CMM, 
MBM, PBM} 


Issue a Reset to one of the Server Management processors 


set manufacturing 


Set serial number, other FRU data 


set partition 


Define the number of partitions, assign partitionable resources to 
each partition, define the partition permissions. 


show config 


Show the entire system configuration 


show CPU 
{processor} 


Show data on an EV7 CPU (specified by processor ID) or all 
CPUs 


show LAN 


Show the nodes on the Server Management LAN 


show memory 


Show information on memory configuration 


show partitions 


Show the defined partition data 


show FRU 


Show the FRU data for the system FRUs 


show power 


Show the thermal and voltage sensor data 


show error 


Show the non-volatile saved error state 


clear error 


Clear the non-volatile saved error state 


update 


Update system firmware 


date 


Set / show the server management time 


examine / deposit 


Display / modify memory 


test processor n 


Run the test identified by n on the specified processor ID 


set test signal 
processor n 


Assert cable test signal for port n (N, S, E, W, I/O) on the specified 
processor ID and light the cable LED. 


clear test signal 
processor n 


De-assert cable test signal for port n (N, S, E, W, I/O) on the 
specified processor ID and extinguish the cable LED. 


check test signal 
processor n 


Test cable test signal for port n (N, S, E, W, I/O) on the specified 
processor ID. 



External Server Management Commands 
Fig. 11 



Command 




Descnpilon 


PutChar 


Send a character to the operator display 


GetChar 


Get a character from the operator keyboard 


SetTermlnt 


Set operator terminal interrupt setting 


Hello 


Announce the present of a Server Management member 


Poll 


Probe for the presence of a specific Server Management member 


No-op 


No operation, used for testing 


SysError data 


System error state information to be saved 


FRUError id, 
data 


Store FRU error data in the FRU specified by id 



Internal Server Management Commands 



Fig. 12 



Cell 


Description 


Seconds 


Second count, 0-59, binary format 


Minutes 


Minute count, 0-59, binary format 


Hours 


Hour count, 0-23, binary format 


Day 


Day of the month, 1-31, binary 
format 


Month 


Month of the year, 1-12, binary 
format 


Year 


Year, 0-99, binary format 



* BB WATCH Data 



Fig. 13 



9 





Me$W£e 


Description 


CSBREAD 


Read data element from the PBM 


CSB_WRIT 
E 


Write data elements to the PBM 


CSB_POLL 


Obtain PBM status 



CSB Messages 
Fig. 14 
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User 



Command input Console traffic 



Platform Management 
Utility 
(PMU) 



Server Mgmt. Cmds <fe Responses 



100baseT Private LAN 



Environment Sensors 1 
Power Supply Oris « 



PBM 

firmware 



MBM 

firmware 



Server Mgmt. Onds & Responses 



■ Environment Sensors 
• Nonvolatile Data 

■ Power Supply Oris 

■ Console Image 

EV7 Reset, halt, SROM 
Power Supply Oris 



CMM 
firmware 



-►fpgai/f 

FPGAI/F 

Environment 

Sensors 

RDRAM SPD 
EV7BIST 

SROM Code 



Server Management Hardware Overview 
Fig. 15 



CMM 



CMM 



Serial Line w 



I 



CMM 



CMM 



Serial Line 



Serial Line 



FSL Jumper 



Quad Uart 



MBM 



ELAN SC520 



Serial Line 



Serial Debug Line 



FLASH 



DRAM 



PCI bus 



NVRAM 



-to,*" 



Ethernet 
Controller 



8584 I2C 
Interface 



I2C bus 



TOY Clock 



EEPROM 



LM80 Fan 
Monitor and 
Control 



BOX 
ID 



6 IP and 8 10 
/Cable connectivity 



yd, 



2- £ 




Private LAN 



System is 

Running 



o o o 

Powcf H«tt Rwt 



OCP 



RACK 
ID 



LM80 Power 
Supply Monitor 



I4BM Hardware Overview 



32P MARVEL SYSTEM 
2M RACK 



RACK 



THUMBWHEEL 



(4) 8P DRAWERS 
EACH HAS A 
THUMBWHEEL 






RACK THUMBWHEEL 



(4) PCI BOXES 
EACH HAS A 
THUMBWHEEL 



4) POWER RACKS 
WITH N+l SUPPLIES 



. (2) 3 PHASE AC INPUT 
FRONT ENDS 



SYSTEM RACKS 



POWER/IORACK 



Rack and Box Thumbwheel Scheme 

Fig. 17 



Group Leader 


1 per Marvel System 1 


Lowest MBM in group 


PMU Server 


1 per Marvel System 1 


Lowest MBM in group 


Partition Coordinator 


1 per hard partition; 
max 8 per MBM 


MBM with lowest EV7 in hard 
partition 


Telnet Server 


2 per subpartition 
(COM0.COM1) 


Grandparent MBM of primary EV7 


DHCP 


1 per Marvel System 1 


Lowest MBM in group 



MBM Task Attributes 



Fig. 18 
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PPP Driver 



UDP 



TFTP 



Marvel SM Protocol 




Group 
Membership 



Partition 
Database 



Marvel SM Protocol 



ARP 



ICMP 



Ethernet Driver 
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tABM Firmware Overview 



Group members 

electa 
Group Leader 




Fig. 20 











Independent Processing 


Unaffected ^ 






Mr Poll Status and State 


Handle MBM hot swap. 
Power that is on is left on, 
power that is off is left off. 


Group Formation 
Majority / Minority 
Replicated Data Sync 


Normal group 


New Group is initiated. A group forms and a leader is selected. 




processing, new 
group is formed 


If there was not a previous majority group, then the replicated 
database is marked invalid. 






If the new group is a minority, mark the database read-only. 






If the new group is a majority, request the database and any 
pending updates from all members who were previously joined to 
the MaxPrevMajorityGroup. 




Apply the longest list of updates to the corresponding database 
copy and send the new initial replicated database to all members. 
All members mark the database as valid. 




If the new group is a majority and there was no previous majority 
group, then clear the powerup_complete flag. 




If the new group is a majority and the powerupcomplete flag is 
set, then proceed to the Hardware Init phase. Else, proceed to the 
Operational phase. 


Minority groups remain in this 
phase 


Hardware Init 


Return to forming a 
new group and re- 
run init 


Poll CMMs to deterrnine CPU module population details within 
each 8P backplane. This initializes the list of available resources. 




The Leader computes a routable configuration for each partition 
based upon the requested and available CPU resources. 




The leader decides to power up the partitions. It commands all 
MB Ms, PBMs, and CMMs to power up. Upon completion, the 
leader obtains the results from each of these commands and 
adjusts the list of available resources accordingly. 




The partition coordinators start XSROM testing on all CPUs for 
memory. 




The PMU Server initiate IP cable testing between 8P backplanes 
and 10 cable testing between 8P backplanes and I/O crates. The 
results are used to recalculate routing and assign I/O to partitions. 




The partition coordinators initiate XSROM tests for I/O and 
routing. Hie results are used to recalculate routing and adjust the 
list of I/O resources. 




The partition coordinators initiate remote memory testing between 
CPUs in the same partitions. 




The partition coordinators initiate interrupt testing between CPUs 
in the same partitions. 




The leader sets the powerup complete flag to true and proceeds to 
the S/W Load phase. 




S/W Load (SRM + O/S) 


New Groups are 
treated as hot-adds 


The partition coordinators elect a primary EV7 in each partition. 
They command all secondaries to spin on RBOX SCRATCH and 
initiate loading of the SRM firmware on the primary. 




The SRM firmware commands the secondary CPUs to join by 
writing KdUA ov*K/Yii^ri. ine primary cv / completer ttu uvj 
initialization. 




If the SRM auto_action environment variable is set to BOOT, the 
operating system boot is attempted on the partition. 




Operational 


New Groups are 
treated as hot-adds 


Server management requests from the primary EV7 in each 
partition are handled by the CMMs / MBMs / PBMs. 




If a new group has caused a change in the CPU, Memory, or I/O 
resources, notify the primary EV7 in each affected partition. 




If a new resource has been pre-allocated to a partition, then the 
partition coordinator takes the steps necessary to probe the IP or 
10 links to the new resource (CPU or I/O drawer). 





Marvel System Powerup Flow with Group relationship 
Fig. 21 









Virtual console terminal access 


Yes 


No 


Firmware updates 


Yes 


No 


Load/Disable Test firmware 


Yes 


No 


Live configuration change 1 


No 


Yes 


Writing SRM environment vars 2 


No 


Yes 


Unsolicited notification of alerts 


Yes 


No 


Store PCI Slot information 2 


No 


Yes 


All others 


Yes 


Yes 



LAN vs FPGA PMU capability matrix 
Fig. 22 
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PMU request processing consists of requests that are serviced by 
the PMU Server itself and requests that are forwarded to other nodes 
for processing. 

• PMU ERROR REPORTS - the PMU Server sends the unsolicited error report 
message to all PMUs and to the Primary EV7 on partition's affected by the error. 



PMU Server Block Diagram 

Fig. 23 











System Discovery 


Get MBM / PBM 
CONFIGURATION 

nnm nr<T PI /"XT' TXTCA 

GET PCI SLOT INFO 


Forward 


Commands are forwarded to the MBM or PBM addressed m 
the message header. Responses are forwarded back to the 
PMU. 




GET PARTITION 
DATABASE 

GET OWN PARTI ITION 
KJIIWRFR 


Direct 


The PMU Server derives the response from his local copy of 
the Partition Database. 


GET SYSTEM TOPOLOGY 


Direct 


The PMU Server keeps track of the applications making this 
multi phase request until the last entity has been requested. 
The entity number in the request is used to index into a list 
composed of me combination of group members and partition 
database. The IP addresses, parent relationship and partition 
number is derived from these values found in NVRAM. If the 
group members or partition database changes before the last 
entity is requested, an error response is returned on the next 
request 


SET PCI SLOT INFO 


Forward 


The PMU Server must ensure tnat mis request is coming irom 
an EV7 and not from the PMU on the LAN. These packets 
are directed to the PBM associated with the slot 


Partition Control 


ALL COMMANDS OF 
GROUP 


Forward 


All commands in this group that contain a partition number 
are forwarded to the MBM running the appropriate partition 
coordinator. The exceptions are Read State of OCP switches, 
OCP Switch assignment ana rower CMVun commanas mai are 
simply forwarded to their destination. 


EV7 Setup 


REQUEST EV7 START 
TEST 


Forward 


This command is forwarded to the destination EV7. 


Cable Test Group 


GET CABLING 
CONFIGURATION 


Direct 


The PMU Server responds with the contents of the Cable 
Database that he composed during Initialization or was 
requested via Reconfigure Cabling. 


RETEST CABLE 
CONFIGURATION 


Complex 


The PMU Server re-initiates the test of all IP and 10 cabling 
making use of the commands Get MBM IP Cabling and Get 
PBM IP Cabling. 


SET CABLE TEST SIGNAL 
GET CABLE TEST SIGNAL 


Complex 


The PMU Server ensures that there are no other on-going 
cabling requests and forwards these commands to the PBM or 
MBM in the destination field and returns the response to the 
PMU. 


Virtual Console 


GET TELNET IP 
ADDRESS/PORT 


Direct 


PMU Server determines the primary MBM's IP Address and 
the socket port. 


Firmware Load 
and Upgrade, 
Environmental 
Retrieval, FRU 
i/aia, E/iTor 
Logging, 
Miscellaneous 




Forward 


All commands in these groups are forwarded to the CMM, 
PBM or MBM in the destination tieia ana me response 
returned to the PMU. 


Date/Time 




Forward 
Direct 


The PMU Server allows Base Time Gets and Sets from all 
PMUs but Delta Time Sets and Gets can only come from 
Partition Primary EV7s. The requests are forwarded to the 
MBM being addressed. 


Miscellaneous 


GET/SET KNOB 
READ/WRITE BLOCK 
DATA 


Forward 


These requests are forwarded to the destination for 
processing. 



PMU Server Received Comand Handling 
Fig. 24 









System Discovery 


Get MBM/PBM 
CONFIGURATION 




GET PARTITION 
DATABASE 




Cable Testing 


SEND CABLE ID 
RECEIVE CABLE ID 
GET MBM IP CABLING 
GET PBM IP CABLING 


These commands are issued in response to a RETEST CABLE 
CONFIGURATION request. The process is discussed in section 
Error! Reference source not found., Error! Reference source not 
found. 


Error Logging 
Group 


ERROR REPORTING 


The PMU Server knows the IP address of client PMUs and distributes 
the alerts to each PMU. 


Miscellaneous 


DISTRIBUTE DHCP LEASE 
DATA 


The DHCP server runs on the PMU Server and keeps track of the 
DHCP clients. For failover purposes, this data is replicated on all 
nodes. See section Error! Reference source not found. Error! 
Bookmark not defined.. 



PMU Server Originating Commands 



Fig. 25 
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|Marvel System Configuration used in this example 




IT] 

in 



i R 




CMM 



CMM 



CMM 



CMM 



CMM 



CMM 



CMM 



CMM 



EV70 



EV70 



EV70 



EV70 



EV70 



EV70 



EV70 



EV70 



EV71 



EV71 



EV71 



EV71 



EV71 



EV71 



EV71 



EV71 



PBM 



PBM 



PBM 



PBM 



PBM 



PBM 



PBM 



PBM 



The PMU's PC connects to the LAN and requests an IP address 



The MBM is running a DHCP server and provide it a lease on a 
DHCP address. 



The PMU application when initializing issues the GET SYSTEM 
TOPOLOGY command starting at 0. The command is issued to th 
PMU Server which is a predetermined address 



Entity 0, the data for the MBM is returned. 



PMU sends a GET MBM CONFIGURATION to the MBM and picks up 
information, like the RIMM population. 



The PMU Server task forwards the command to the MBM SM 
protocol servicing task. It returns information on the CPUs that is 
has gathered previously. ^^^^ 



The PMU issues the GET SYSTEM TOPOLOGY for entity 1 



Entity 1, the CMM, is returned. 



Show Config Flow Diagram (Part 1) 




The PMU issuesfhe GET SYSTEM TOPOLOGY for ntity 2 



Entity 2, the data for the EV7-0 is returned. 



The PMU issues the GET SYSTEM TOPOLOGY for entity 3 



Entity 3, the data for the EV7-1 is returned. 



The PMU issues the GET SYSTEM TOPOLOGY for entity 4 



Entity 4, the data for the PBM is returned. 



The PMU issues a GET MBM IP CABLING to the PMU Server 



IP Cabling data is returned 



Show Configuration Flow Diagram (Part 2) 




GET PARTITION DATABASE 



PMU Server delivers the database 



The PMU uses the information from the REQUEST COMPLETE LAN 
TOPOLOGY, and issues commands with IP addresses. It issues GET 
VOLTAGE READINGS to the MBM 



The PMU Server passes the command to the destination, the MBM. The 
MBM responds with the voltage readings. 



The PMU uses the information from the REQUEST COMPLETE LAN 
TOPOLOGY, and issues commands with IP addresses. It issues GET 
VOLTAGE READINGS to the PBM 



The PMU Server passes the command to the destination, the PBM. The 
PBM responds with the voltage readings. 



The PMU uses the information from the REQUEST COMPLETE LAN 
TOPOLOGY, and issues commands with IP addresses. It issues GET 
VOLTAGE READINGS to the CMM 



The PMU Server passes the command to the destination, the CMM. The 
CMM responds with the voltage readings. 



The PMU Server queries the PBM for information on the IO drawers with th 
GET PBM CONFIGURATION command 



The PBM supplies information on each 107 Riser in the IO Drawer 



GET PCI SLOT INFO 



The PBM may have stored information on the PCI configuration if it was 
stored by SRM console in the PBM ram. 



The process is complete. 



Fig. 29 Show Configuration Flow Diagram ( Part 3 ) 
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OS App 
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EV7 
Status 



MBM Poll 
of EV7s 



Partition 
Coordinator 



OCP Switches 



Partition Request Sources 
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Move EV7s to Partition 
Remove EV7s from 
Partition 


Complex 


^^Hunning OS 


Check the proper cabling of a n^pFformed hard 
partition or additions to an existing partition. 
Determine memory and routability. Distribute the 
requests on the TRAIN to update volatile Databases. 




Assign Memory or 10 
to Sub Partition 


Trained 


Set Partition State 
Attributes 


Trained 


Switch Primary EV7 


Complex 


Partition Running OS 


Distribute the requests on the TRAIN to update 
volatile Database. 




Assign Sub Partitions 


Trained 


Assign Memory or 10 
to Sub-partition 


Trained 


Add EV7or Delete EV7 
to/from Running 
Partition 


Complex 


Partition Running OS 


Cable testing is performed to determine proper 
connections ; A Quiesce request is made to all EV7s 
in the partition; new Rconfig/Cconfig requests are 
sent to all EV7s and if acceptable Continue is sent to 
the EV7s. If an error is found in routing new 
Rconfig/Cconfig computations are attempted and sent 
to the affected EV7s. 


Figure 16 


Save Partition 
Assignment 


Trained 


Don't Care 


Send the save command on the train so that all copies 
of volatile database for the partition can be copied to 
non-volatile. 


Figure 9 


Reset Partition 

3 
y 


Complex 


Partition Reset in 
Progress or Partition 
running OS 


Pulse Reset on all EV7s in partition, Reload SROM, 
XSROM on all EV7s, reconfigure Routing, send 
Rconfig/Cconfig to all EV7s and if no errors, Load 
SRM to primary. 


Figure 11 


Partition Powered Off 


Return Error 




-Power Off Partition 

n 

; s 

Ui 


Complex 


Partition Reset in 
Progress or Partition 
running OS 


If Dual EV7 in partition or EV7 in free pool, send 
Power Off EV7s to each such CMM in partition. 
Power off PCI Drawer on PBMs that have all 107 
risers in partition. If power is off for all CMMs in a 
cabinet of MBMs, power off the power supplies in the 
cabinet. 




Partition Powered Off 
or request made to sub 
partition 


Return Error 




-Power On Partition 

h 

J 
1 


Complex 


Partition Reset in 
Progress or Partition 
running OS 


Return Error 






Partition Powered Off 


Turn Power on to any Power Supplies that are off and 
under control of Cabinets that have EV7s assigned to 
our partition. Power up PCI drawers for PBMs mat 
have I07s in our partition. Power up Dual EV7s on 
CMMs that have EV7s in our partition. Continue like 
the reset process. 




Halt Partition 


Forwarded 


Partition Reset in 
Progress or Partition 
running OS 


Send Halt On to primary Ev7 of partition. 




Partition in Halt State 
or Partition Power off 


Return Error 




Disable Halt Partition 


Forwarded 


Partition Reset in 
Progress or Partition 
running OS 


Return Error 




Partition in Halt State 
or Partition Power off 


Send Halt Off to primary Ev7 of partition 




Store Environment 
Variables 


Trained 


Partition running OS 


This causes a distribution of the SRM environment 
variables to all peers 


Figure 34 


Get Environment 
Variables 


Direct 


Partition running OS 


Return local copy of all SRM environment variables 





Partition Coordinator Handling of Requests 



Fig. 32 



Train Full 




EV7 Quicscc 



Partition Reset in 
Progress 



CMM facilitates 



Figure 17, Figure 20 



Config Rbox/Cbox 



Partition Reset in 
Progress 



CMM facilitates 



Figure 17, Figure 20 



EV7 Reset 



Any 



CMM facilitates 



Figure 15 



EV7 Start Test 



Partition Reset in 
Progress 



CMM facilitates 



Figure 16, Figure 18 



EV7 Halt 



Any 



CMM facilitates 



Load Image 



Partition Reset in 
Progress 



CMM facilitates 



Figure 15, Figure 20 



Set Partition State 



Partition Reset in 
Progress 



CMM facilitates 



Figure 75, Figure 16, Figure 17, 
Figure 18, Figure 20, Figure 21 



Power On/Off 



Any 



CMM, MBM, and PBM 
facilitates 



Partition Coordinator Commands Issued 



Fig. 33 




Partition State Diagram 
Fig. 34 



Partition 
Data 

User described 
allocation of 
resources. 

Soft/Firm/Hard 



Current 
Configuration 

EV7s, 107, Cables, 
Fillers. 
Results of 
diagnostics. 



Routing 
Rules 

one bend 
first hop 
adaptive 
SRC 



Routing 
Tables 

EV7 node ids 

clumps 
RBOX ROUTE 



Inputs and Outputs of Router algorithm 
Fig. 35 



Routing Glossary 

Primary dimension: one of EAST- WEST or NORTH-SOUTH. This choice is 
the same for all EV7s. 

Secondary dimension: the other way. 

Dimension-order routing: the shortest path connecting two nodes which 
proceeds first along the primary dimension and then along the secondary. 

Adaptive routing: the collection of paths advancing node-to-node in the same 
primary and secondary directions as the dimension-order routing. At each 
intermediate node it must be possible to advance in either direction until the 
dimension coordinate in a direction matches that of the destination. 

Initial hop: a routing option which allows a hop from the source node in any 
direction to an adjacent node. This option allows some connection of nodes in 
imperfect meshes. 

SRC routing: another deadlock-free routing method in which travel proceeds 
first along the secondary dimension. 



Fig. 36 Routing Glossary 
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PIDs are assigned to 
each EV7 in the partition 
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Start Diagnostics 
on each CPU in 
the partition 




37/^ 



6 



Gather diagnostic 
results from all CPUs 



Configure Routing 
Parameters 




Determine the 
primary EV7 



r, 




Start the SRM on 
primary. Ready the 
secondaries. 



Idle state. 
Serve requests 
from PMU. 



Partition Coordination 



?" 3 7 



EV7EV7EV7EV7 
107 107 107 107 

EV7 EV7 EV7 EV7 
107 107 107 107 



SPO 



HPO 




At initial poweron, the unconfigured 
Marvel system is configured to have all 
resources in a single subpartition. The 
global free pool (HP 255) is empty. 



Marvel System 



EV7EV7EV7EV7 
107 107 107107 

EV7EV7EV7EV7 
107 107 107 107 
SPO 



HPO 



HP 1 



SP 
255 




HP 
255 



The user creates hard partition 1 (HP1) with 
subpartition 0 (SP 0). The partition free pool 
(SP 255) is created automatically. 



Marvel System 






EV7 




I07 




EV7 




I07 




EV7 




107 




EV7 




107 




HP 




255 - 



The user deletes several EV7s from the hard 
partition (HP 0) and they migrate to the global 
free pool (HP 255). 
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The user can move the EV7s into the new partition, 
(HP 1.SP 0). By default the I07s are assigned to the 
same partition as the EV7 to which it belongs. 



Creating a Hard Partition Block Flow 
Fig. 38 
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Marvel System 



The initial system defaults all the resources into 
one partition. 



The user created a 2nd subpartition (SP 1) within 
the existing hard partition (HP 0). 



The user deletes EV7s from SP 0, migrating them 
into the partition free pool (SP 255). Unlike moving 
them out of the hard partition, the I07s do not stick to 
their EV7s. The user issues separate delete I07 
commands, and in this example, only migrat s 2 I07s. 



In configuring the new subpartition (SP 1), EV7s are 
Moved into the partition. Again note the I07s are 
acted upon independent of the EV7. 



To get the I07s into the new subpartition, an 
Assign command is used. 



Creating a Subpartition Block Flow 
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The data is distributed to all MBMs and PBMs on the train with a FULL TRAIN 

transmission. 




The PMU Server replies successfully after all the MBMs/PBMs have the update. 



The user associates each 107 to a hard partition & sub partition 



PMU 



ASSIGN 107 TO SUB PARTITION 
stored in volatile database 



The data Is distributed to all MBMs and PBMs on the train with a FULL TRAIN 

transmission. 



The PMU Server replies successfully after all the MBMs/PBMs have the update. 



Creating a New Partition Flow Diagram ( Part 1 of 2) 
Fig. 40 
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The PMU Server replies successfully after all the MBMs/PBMs have the update. 
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The user indicates that he/she is done setting up the partition. 
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The PMU Server replies successfully after all the MBMs/PBMs have the update. 
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Done. The user can now start the partition. 



Creating a New Partition Flow Diagram ( Part 2 of 2) 
Fig. 41 



RESET STATE 



PMU 


PMU 
Server 


m 


MBMs 


CMMs 


EV7s 


After a group formation, the leader reconciles the partition database and starts 
up a partition coordinator for each partition. The PC is started on the lowest 
MBM id in the partition. 
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Each CMM in the partition is queried with the GET CMM STATE command. 
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Each CMM returns the status of the EV7s it controls. 
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The MBM assembes the data from all the CMMs into the reply to the GET 
MBM CONFIGURATION 
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Each PBM in the partition is queried for state of the CMMs with the GET PBM 
CONFIGURATION request 
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The PBMs reply with the 107 configuration. 
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The P.C. sets the state of the partition to RESET-IN-PROGRESS with the 
SET PARTITION STATE. 
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The command goes to all MBMs in the entire system, not just the ones in this 
partition. The MBMs record the state. See the "MBM Start Partition State 

Diagram." 
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The CMM stores the PID information in ram that is accessible by the EV7 for 

later retrieval. 
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The Partition Coordinator performs a partition reset by issuing, individually, a 
PULSED RESET to each EV7 in the partition. 
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The CMM intercepts this command and performs the PULSED RESET on the 
EV7s. The CMM facilitates the FPGA load and SROM load which then loads 
the XSROM the the LOAD XSROM IMAGE packet. 



Partition Start Flow Diagram ( Reset State ) 
Fig. 42 



DIAGNOSTIC STATE 




The P.C. sets the state of the partition to DIAGNOSTICS-IN-PROGRESS with 
the SET PARTITION STATE. 



The command goes to all MBMs in the entire system, not just the ones in this 
partition. The MBMs record the state. See the "MBM Start Partition State 

Diagram." 



After all EVTs are in XSROM, the P.C. commands all EV7s individually to 
start the first diagnostic test. P.C. repeats this operation for each of the tests 
in the suite using the EV7 START TEST. 



The CMMs receive the EV7 START TEST and pass the instructions up to the 
XSROM running on the EV7. 



The suite of tests is started sequentially by the partition coordinator until all the 
tests are complete. 



The Partition Coordinator asks the PMU server to perform the cable testing 
with a RECONFIGURE CABLING. 



The PMU Server coordinates the cable testing and issues GET MBM IP 
CABLING and GET PBM 10 CABLING. The targets then issue RECEIVE 
CABLE ID and SEND CABLE ID. 



When the cable test operation is complete, the PMU Server responds to th 
requesting P.C. with a completion status. The P.C. gets the latest results from 
the PMU Server with the GET CABLE CONFIGURATION request. 



The PMU Server supplies the latest cable configuration data in the reply. 



The cable connectivity, the diagnostic test results, the striping information, and 
the partition database are used in CTABLE to calculate PIDs and Routing 

Tables. 



Figure 43 Partition Start Flow Diagram, Diagnostic State 
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The P.C. sets the state of the partition to CONFIGURE-ROUTER-IN- 
PROGRESS with the SET PARTITION STATE. 
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The command goes to all MBMs in the entire system, not just the ones in this 
partition. The MBMs record the state. See the "MBM Start Partition State 

Diagram." 
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QUIESCE PARTITION is sent to all EV7s in the partition. In this example, the 
EV7s are in XSROM, which is already a quiesced state. 
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This command is serviced by the CMM and performs the necessary steps to 
have the EV7 (still running XSROM) configure the router. 
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This command is serviced by the CMM and performs the necessary steps to 
have the EV7 (still running XSROM) configure the router. 
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Continued on next flow 



Partition Start Flow Diagram (Configure Router) 



Fig. 44 
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PARTITION RUNNING 



The command goes to all MBMs in the entire system, not just the ones in this 
partition. The MBMs record the state. See the "MBM Start Partition State 

Diagram." 




The P.C. sets the state of the partition to CONTINUE-PARTITION-IN- 
PROGRESS with the SET PARTITION STATE . 



The non-primary EV7s are given an EV7 START TEST that sets them waiting 
for a flag to jump into the running image. 



This command is forwarded by the CMM and EV7s are now ready and waiting 



The partition is now completely configured. All EV7s are running XS ROM. 
The P.C. now directs the primary EV7 to start the SRM console via the LOAD 

IMAGE 

The CMM intercepts this command and performs the necessary operations to 
get the Primary EV7 loaded and running. 



The Primary EV7, writes a flag in each of the other EV7s , indicating that they 
should jump into the running image. 



The P.C. sets the state of the partition to PARTITION RUNNING with the SET 
PARTITION STATE. 



The command goes to all MBMs in the entire system, not just the ones in this 
partition. The MBMs record the state. See the "MBM Start Partition State 

Diagram." 

The P.C. notifies the PMU server in the system that the partition has been 

started. 



The PMU Server notifies all the connected PMUs that the partition has been 

started. 



The End 



Partition Start Flow Diagram ( Running ) 
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When the train completes, the Part. Coord, commands each EV7 in hard 
partition #2, individually, to QUIESCE. 
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QUIESCE is recieved at the CMMs in the partition and and they take actions 
to quiesce the EV7, EV#4 and EV#5 are in XSROM and do not have to be 
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CONFIG RBOX/CBOX is sent to all EV7s in the partition, which includes 
EV#4 and EV#5 which are in XSROM. 
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SET PARTITION STATE to CONTINUE-PARTITION-IN-PROGRESS. This is 
distributed via the train mechanism. 
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SET PARTITION STATE to PARTITION RUNNING is issued on the train. 
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The Part Coord, notifies the PMU Server that the ADD EV7 TO PARTITION is 
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The End. 
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Destroying a soft partition 
Fig. 48 
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Fig. 49 
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The parent MBM sends a 
SYSEVENT to the primary EV7. It 
has timed out so this SYSEVENT 
gets dropped. 



EV7 Failure/Replace Flow Diagram (Part 1) 
Fig. 50 
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The group is formed MBM3 is now an active member. 



Set Membership Configuraton Flow Diagram 

Fig. 52 



The EV7 Id7(x^yj^J^termined by the thumb-wheel setting using the^^^ng algorithm: 
x (E,W coordinate) = ((Rack Number»2)*8) + ((MBM number»l)*4) + CMM number 
y (N,S coordinate) = ((Rack Number & 0x03)*4) + ((MBM number & 0x0I)*2) + EV7 number 
where: 

Rack Number is the high order half byte of the MBM thumb-wheel 

MBM Number is the low order half byte of the MBM thumb-wheel 

CMM Number is from 0 to 3 within an MBM 

EV7 number is 0 or 1 within a CMM 

In a similar manner when the x,y axis coordinated of an EV7 are known, the thumb-wheel numbei 
can be derived and inserted into the IP address for the MBM, CMM and EV7s. 



EV7 Coordinate addressing relationship to thumbwheel addressing 

Fig. 54 
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Fig. 59 
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Virtual Console Terminal Overview 

Fig. 60 
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Virtual Terminal Telnet 



Fig. 61 



Virtual Terminal Session 



"B 

PMU 


PMU 
Server 


Telnet 
Svr for 
PriEW 


MBMs 


CMMs 


EWs 


The PMU platform is plugged into an available port on the SM LAN 


PMU — 


PMU 
Jjerver 


Telnet 
Svr for 
Pri EV7 


MBMs 


CMMs 


EWs 


The PMU sends a Get Telnet IP Address/Port request to PMU Server for the 
address of the telnet server for the primary EW for a partition 


PMU^ 


PMU 
Server 


Telnet 
Svr for 
PriEW 


MBMs 


CMMs 


EWs 


PMU Server gives to the PMU the address of the telnet server for the primary 

EW 

(Get Telnet IP Address/Port response packet) 


PMU— 


PMU 
Server 


Telnet 
Svr for 
P£EW 


MBMs 


CMMs 


EWs 


User starts a telnet session on the PMU using the telnet server address from 

previous step 


~B 

PMU 


PMU 
Server 


Telnet 
Svr for 
PriEW 


MBMs 
— ► 


CMMs 


EWs 


Telnet server passes characters to Virtual Console task on MBM for Primary 

EW 


~a 

PMU 


PMU 
Server 


Telnet 
Svr for 
PriEW 


MBMs 


CMMs 
— ► 


EWs 


MBM for Primary EW passes characters to CMM for Primary EW using 
PUTCHAR packet 


PMU 


PMU 

Server 


Telnet 
Svr for 
PriEW 


MBMs 


CMMs 


EWs 


CMM strips off IP addressing info and passes the character to Primary EW 
through the virtual console uart registers 


PMU 


PMU 
Server 


Telnet 
Svr for 
PriEW 


MBMs 


CMMs 


EWs 


Primary EW responds with characters back to CMM 


"a 

PMU 


PMU 
Server 


Telnet 
Svr for 
PriEW 


MBMs 
M— 


CMMs 


EWs 


CMM envelops character in PUT.CHAR protocol packet and gives to MBM 


PMU 


PMU 
Server 


Telnet 
Svr for 
PriEV^ 


MBMs 


CMMs 


EWs 


MBM Virtual Console task passes character to Telnet server 


PMU** 


PMU 

Server 


Telnet 
Svr for 
PriEW 


MBMs 


CMMs 


EWs 


Telnet server passes character to Telnet session on PMU 



Virtual Terminal Flow Diagram 
Fig. 62 



SET BASE TIME 



n 

PMU 


rlVlU 

Server 


MBMs 


PBMs 


The PMU is plugged into an available port on the SM LAN, gets an IP address 


PMU — 


□ Rill 1 

rMU 

Sjgrver 


MBMs 


PBMs 


The PMU sends a Get Base Time request to PMU Server 


PMU-< 


PMU 
Server 


MBMs 


PBMs 


PMU Server gives to the PMU the current base time in ? format 


□ 

PMU 


PMU 
Server 


MBMs 


PBMs 


User types in new time at PMU 


"H 

1 ^ 

PMU— 


PMU 
^grver 


MBMs 


PBMs 


PMU give new time to PMU server inSet Base Time packet 


"a 

PMU 


PMU 
Serve^ 


Group 
Leader 
MBM^ 


PBMs 


PMU Server gives new base time to group leader's time server 


PMU 


PMU 
Server 


MBMs 


N ^ls 


New base time is propagated among MBMs and PBM through the base time 

synchronizer task 



Set Base Time Flow Diagram 

Fig. 63 













MBM/PBM Firmware 


"mbmfw" , 
"pbmfw" 


2MB 


0 


7 


CMM, CMMJFSL, FPGA, 
SROM, XSROM Firmware 


"cmmfw" , 

"cmmfsr, 

"cmmfpga", 

"sromfw", 

"xsromfw" 


0.5 MB 


8(0,tbd,tbd,tbd,tbd,tb 
d) 


9 


Error Logs 




1 MB 


10 


13 


MBM/PBM FSL Firmware 


"mbmfsr, "pbmfsl" 


0.5 MB 


14 


15 


NVRAM - partition database 




0.75 MB 


16 


18 


SRM Firmware 


"srmfw" 


2MB 


20 


27 


FPGA loaded by PBM on 
PCI Drawers 


"pbmfpga" 


0.25MB 


28 


28 


MBM/PBM Boot[if required 
by HW] 




0.25 


19(0,0x30000) 


19 



Flash Layout 
Fig. 65 




8.. 19 


Image Revision in ASCII 


20.. 23 


Vendor String in ASCII (CPQ) 



0..7 



0x010100005500aaff 



24.. 31 



Module ID in ASCII 

(SRMFW,MBMFW,MBMFSL,CMMFW,CMMFSL,SROMFW,XSROM 
FW.CMMFPGA) 



32.. 35 



Firmware Type in ASCII (ALPH, X86) 



36.. 43 



0x00 



44.. 47 



Code Length in bytes 



48.. 59 



ROM Object Name (FW.FSL.SROM.XSROM.FPGA) 



60.. 63 



0x11223344 



Image Header 
Fig. 66 



All 
MBMs 
PBMs 


MBM 


1 

CMM 


Pi 


The primary CPU in the partitioiBKues the command 
»> set bootdef dev dkalOO 
This becomes a STORE ENVIRONMENT VARIABLES packet 


All 
MBMs 
PBMs 


mm 


CMM 


SRM 


MBM waits for the train to arriv and th n retransmits the FULL TRAIN 
MESSAGE with the STORE ENVIRONMENT VARIABLES payoad. 


WMm 


MBM 


CMM 


SRM 


All MBMs receive the train, copy out the payload and hold that payload as a 
pending command. The MBM passes along the FULL TRAIN MESSAGE, 
and wait for the empty train. 


All 
MBMs 
PBMs 




CMM 


SRM 


The train makes it full circle back to the originating MBM. It then commits the 
SRM environment variables to their flash. It then puts the FULL TRAIN 
MESSAGE into the train payload and reissues it. 


fllilll 


MBM 


CMM 


SRM 


All MBMs commit the data to their flashes and pass on the FULL TRAIN 

MESSAGE. 


All 
MBMs 
PBMs 




CMM 


SRM 


The train makes it full circle back to the originating MBM. It now can respond 
to the STORE ENVIRONMENT vakiadLLo command ana senas oui me 
EMPTY TRAIN MESSAGE. 


All 
MBMs 
PBMs 


MBM 


CMM 


^SSRMffi 


The reply passes through the CMM and back to the EV7 running the SRM 
console with a successful completion status. 



SRM Environment Vars Flow Diagram 
Fig. 67 
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Remote 
TFTP 
Server 

B 



MBM 


f 


Firmware 




Upgrade 






Firmware Load and Upgrade Block Diagram 
Fig. 68 




UPGRADE FIRMWARE for CMM issued by PMU Server 



The PMU Server forwards the command to the MBM that is parent 
to the CMM. 



The MBM starts a TFTP client and pulls the files for the upgrade. 
The MBM requests the files cmmfw, cmmfsl, 
cmmfpga.sromtw.xsromfw. 



The MBM writes the files to its flash and then sends an UPGRADE 
FIRMWARE command to the CMM. 



The CMM starts up a TFTP session and pulls the files from the 
MBM which acts as the TFTP server. The CMM requests the files 
cmmfw, cmmfsl, cmmfpga, sromfw,xsromfw 



The CMM writes its flash and responds to theUPGRADE 
FIRMWARE 



The MBM repeats this upgrade for all MBM that it controls 



The MBM responds to the PMU Serve'sUPGRADE FIRMWARE 
request.. 



The PMU Server responds to the PMU's UPGRADE FIRMWARE 
request. 



Upgrading CMM Firmware Flow Diagram 

Fig. 69 
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Ell 
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till 
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Entry Number 
(1-0xfffe before wrapping) 
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2 
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Time Stamp 
(ssmmhhDDMMYY) 
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bntry size 
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n+A 


tntry uata 



£rror log £>?fry Format 
Fig. 70 



PI 3 



□ 
i sa S 




Entry Number 
Sererity Level 



Entity in Error 
Instance 



Error Code 
Serial Number 



"TO" 



"TO" 



vanaoie uata 



n ~T9~"n+TO 



TP address of CMMTTABIWTT^^ encountered" 
the error. 



Entry Number 



TnfbrniatIonaf^OyWarning= 1; Error=2; 



Severity Level 



The device code for the device in error (e.g. CMM.RIMM, 
EV7, Thermal, Volatage) 



Entity in Error 



Instance 



The instance of the entity 



Error enumeration or index into a set of text messages 



Error Code 



Identifying address where the error occurred. 
Additional data specific to this error code. 



Serial Number 



Variable Data 



Error Entry Data Format 
Fig. 71 



PMU 


PMU 
Server 


MBM 




EV7 


ERROR REPORTING to MBM with PMU Alert, MBM OCP 


PMU 


PMU 
Server 




CMM 


EV7 


MBM places error entry to OCP, logs error to NVRAM, responds positively to 
originating CMM and sendsERROR REPORTNG to primary EW of affected 
partition, and also to the PMU Server. 


PMU 




MBM 


Biff 


EV7 


The CMM aknowledges reciept of theERROR REPORT to the MBM 
CMM sends SYSEVENT to interrupt OS and sends the error report message. 

The PMU Server sends anERROR ALERT to all the PMUs. 


PMU 


/PMU 
/Server 




CMM 


H 

1 




The OS sees an interrupt, retrieves theSYSEVENT, and aknowiedges the intenrupt 
Tine MBM receives theERROR REPORT response from the CMM. 


1§B^ 


RMU 
Server 


MBM 




EV7 


The PMU receives theERROR ALERT 
The CMM receives the response from theSYSEVENT 



Error Reporting Flow Diagram 
Fig. 72 




Field Replaceable Unit 
Fig. 73 
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< Overall Progress > 


2 


< Current State > 


3 


< Location within State > 


4 


< Error Message > 



OCP Template 
Fig. 74 



01 3456X 
P PPFP 
110 11111 
EV 5 RIMM 2 Parity 

OCP 8P Example 
Fig. 75 



01 3456X 
P PPFP 
110 11111 
Power Halt 
Reset 



OCP Button Label Example 
Fig. 76 




OCP Switches Block Diagram 
Fig. 77 









SET ATTENTION 
INDICATOR 


Light, Extinguish LED at MBM, PBM, 
CMM or Cabinet 


Take action according to the desired state in the request. 


SET KNOB 


Name/value pair to control some 
MBM/PBM capabilities 


Coded into the Image is a list of variable names that can be 
modified. 


GET KNOB 


The value currently maintained for the 
named variable is returned. 


Check to see if the name is in the list and return it's current 
value in the response. 


READ 


Allow debug read of physical memory 
or I/O. 


Check on validity of request and if valid, read physical 
memory space or direct I/O space. For debug. 


WRITE 


Allow debug write of physical memory 
or I/O. 


Check on validity of request and check MMU protection 
privileges to write in the space so as not to cause protection 
violations. If not protected, write the block. For debug. 



^ Miscellaneous Command Handling 

;U Fig. 78 

m 



mmpMmm 










Show_config 


0 




See Section "Show Configuration 
with FRU Data" 


Make requests to PMU Server 


Reset 


2 


1 - Partition No 

2- Sub Partition No 


Returns OK or error 


Send Reset Partition to PMU Server 


Power_on 


2 


1 - Partition No 

2- Sub Partition No 


Returns OK or error 


Send Power On Partition to PMU 
Server 


Poweroff 


2 


1 - Partition No 

2- Sub Partition No 


Returns OK or error 


Send Power Off Partition to PMU 
Server 


Halton 


2 


1 - Partition No 

2- Sub Partition No 


Returns OK or error 


Send Halt on Partition to PMU 
Server 


Halt_off 


2 


1 - Partition No 

2- Sub Partition No 


Returns OK or error 


Send Halt Off Partition to PMU 
Server 


Prepare_EV7_List 


2-16 


1- MBM Rack- 
thumb- wheel, 

2- Ev7 Id (0-7) 
up to 8 pairs 


OK if all elements are in the same 
hard partition or free pool 


Saves this value in MBM RAM for 
use with the next Add EV7s, Free 
Ev7s. Lasts until next Prepare EV7 
List. 


Add_Ev7s 


2 


1 - Partition No 

2- Sub Partition No 


Take the values in the Ev7 list and 
add it to the partition. 


Send command to PMU Server. 


Free_Ev7s 


0 




Take the values in the Ev7 list and 
remove them from the partition 
indicated. 


Send command to PMU Server. 


Save_partition 


2 


1- Partition No 

2- Sub Partition No 


The partition database gets stored to 
NVRAM. 


Send command to PMU Server. 


Destroy _partition 


2 


1- Partition No 

2- Sub Partition No 


Reset & Free all Ev7s from 
partition. 


Send command to PMU Server. 


Ev7_test 


3 


1- MBM Rack- 
thumb-wheel, 

2- Ev7 Id (0-7). 

3- Test Number 


Test Status 


Send a Ev7 Start Test request to the 
CMM. 


Addcabte 


5-6 


1 - Source - MBM 
Rack-thumb-wheel, 

2- Ev7 Id (0-7), 

3- Port(N,S,E,W), 

4- Destination - 
MBM/PBM Rack- 
thumb-wheel, 

5- Ev7 Id(0-7) or 
107 Id(0-3), 

6- Port(N f S,E,W) or 
blank when 107 


This command assists in locating 
the proper connector pair to connect 
the cable. The leds at each 
connector are lit until the 
connection is complete. 


The commands Set Cable Test 
Signal State and Get Cable Test 
Signal State are sent to the 
appropriate MBM and PBM to 
cause the leds to light and check the 
connection itself. 


New_cabling 


0 




Redo cabling tests. 


Send Reconfigure Cabling to PMU 
Server. 


Showcabling 


0 




Displays a list of IP & IO Cabling 


Send Retrieve Cabling 
Configuration to PMU Server. 


Virt_console 


3 


1- Partition No, 

2- Sub Partition No, 

3- COM Port(l,2) 


Open a session with primary EV7 
& intercept COMx Port Data. 


Use PutChar streams for both 
display and keyboard data until the 
keyboard data sequence 
'ESC'ESC'S'M' is recognized as an 
exit of the session. 


Getfans 


1 


1 -MBM/PBM Rack- 
thumb-wheel 


RPM and threshold that fans are 
running at. 


Determine appropriate IP address 
for destination and send a Get Fan 
RPM Speed message. 


Setjan 


3 


1- MBM/PBM 
Rack-thumb-wheel , 

2- Instance of Fan, 

3- RPM 


Error or OK 


Determine appropriate IP address 
for destination and send a Set Fan 
RPM Speed message. 


Errorcounts 


0 




Returns a list of the error counts on 
all MBM/PBM error logs. 


Send Error Log Count request to 
each MBM/PBM. 


Errorclear 


1 


1- MBM/PBM 
Rack-thumb-wheel 


OK 


Send Error Log Clear request to 
destination 


Geterrors 


1 


1 -count of the 
number of errors to 
be reported on each 
device. 1 


A list of the last Error Messages in 
English as it would appear on the 
OOP with any qualifying data 
formatted as appropriate. This is 
repeated for each MBM and PBM. 


Get the ERROR LOG COUNT 
from each micro. Send Error Log 
Entry Retrieval Requests to each 
micro using the highest number as 
the 1 B request. 



Get time 



0 



Date and time is displayed as 
dd/mm/yy hh:mm:ss 



Use Get base Time command 



Set time 



1-Date and Time 
entry in 

format: "dd/mm/yy- 
hh:mm:ss" 



Redisplays date and time 



Set Base Time and Announce Base 
Time Change is sent to all MBMs. 



Req_knobs 



2-3 



3- 



MBM/PBM 
Rack-thumb- 
wheel, 

DeviceCMBM 
", "PBM", 
"CMM"), 
If CMM in 2, 
then number 
(0-3) 



Names and values of all possible 
knobs are listed. 



Request Knob command for all 
possible knobs for that device. 



Set knob 



4-5 



1- MBM/PBM 
Rack-thumb- wheel , 

2- Device("MBM\ 
"PBM", "CMM"), 

3- IfCMMin2, then 
number (0-3) 

2- Knob name, 

3- Knob Value 



OK 



Set Knob on requested micro. 



Firmware version 



3-4 



1- MBM/PBM 
Rack-thumb-wheel, 

2- Devtce("MBM\ 
"PBM", "CMM"), 

3- If CMM in 2, men 
number (0-3) 

4- Module ("CMM", 
"FPGA\"SROM", 
"XSROM","MBM 

"PBM","CMM_FS 
LVMBM_FSLV 
PBM_FSL","PBM_ 
FPGA") 



Returns the version number 



Report Firmware Version 
Command 



Firmwareupgrade 



4-5 



1- MBM/PBM 
Rack-thumb- wheel , 

2- Device("MBM", 
"PBM", "CMM"), 

3- IfCMMin2, then 
number (0-3) 

4- Module("CMM", 
" FPGA" , " SROM* , 
" XSROM " , " MBM 

"PBM","CMM_FS 
L\"MBM_FSL\" 
PBM_FSL","PBM_ 
FPGA") 

5- TFTP Server IP 
Address 



Makes the terminal into a PPP 
serial link making TFTP requests 
until completion of the transfer or a 
timeout occurs. Possible return 
values are: "Complete", 
"Timeout", "File too long", "File 
too short" 



Send the Upgrade Firmware request 
to the MBM or PBM or CMM. 
Make the backup copy where 
required. MBM has a copy of 
CMM program. 





Load test version 



4-5 



1- MBM/PBM 
Rack-thumb- wheel , 

2- Device( M MBM\ 
"PBM", "CMM"), 

3- IfCMMin2, then 
number (0-3) 

4- Module ("CMM", 
"FPGA\"SROM", 
"XSROMVMBM 

"PBM","CMM_FS 
L","MBM_FSL"," 
PBM_FSL\"PBM_ 
FPGA") 

5- TFTP Server IP 
Address 



Makes the terminal into a PPP 
serial link making TFTP requests 
until completion of the transfer or a 
timeout occurs. Possible return 
values are: "Complete*', 
"Timeout", "File too long", "File 
too short" 



Send the Load Test Version 
Command to the MBM or PBM or 
CMM, which maintains a copy of 
the program in MBM memory. 



Disable test version 



3-4 



1- MBM/PBM 
Rack-thumb-wheel, 

2- DeviceCMBM", 
"PBM", "CMM"), 

3- IfCMMin2,then 
number (0-3) 

4- Module ("CMM", 
"FPGAVSROM", 
"XSROMVMBM 

"PBMVCMM_FS 
L","MBM_FSL"," 
PBM FSLVPBM_ 
FPGA") 



OK 



Send Disablejestversion 
command 



CLI Commands 



Fig. 79 C 
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CLI_PORT_SPEED 


1 L\A) t £*HA/, *rO\A/, 7WU, ly^UV/, JtrtW, 

57600, 115200, 230400 


Sneed between COM Port and Modem (detault 570UODDS) 


yi 1 T ¥■* A T 1 A T1 XT' C* 

CLI_DATA_BiTS 


C "7 
5, / 


PHM Pnrf II APT n«»« 7 or R data hits before stOD ("default 8} 


CLI_STOP_BITS 


1, 1-5,2 


COM Port UART sends 1, 1.5 or 2 stop bits to modem 
(default 1) 


CLIFLOWCTL 


HW, SW, NONE 


riow control, riw — kio/li o signals ^uerauii;, 
SW-Xon/Xoff bytes, None 


CLIMODEM 


YES, NO 


If no modem is connected use no; otherwise the following set 
of CLI MDM knobs are required. 


CLIMDMINIT 


AT string for modem initialization 


On each hang-up or drop of carrier signal this command is 
sent to the modem (default is "ATZ"). If modem doesn't 
respond with OK, 3 retries are attempted. 


CLI_MDM_DIAL 


AT string when we dial out to drop an alert 
message or dial-back. 


Prefix for dialing the number indicated in the alert number or 
dial-back number, (default is "ATDT"). If modem responds 
with OK, communication is considered to be established, else 
3 retries are attempted. 


CLI_DIAL_BACK 


Phone Number with dialing pauses 


For security purposes whenever a connection is made, the 
program will hangup and dial the indicated number to 
establish connection, (default empty) 


CLIDIALALERT 


Phone Number with possible dialing pauses 
for a receiver of alert messages. 


If an error message has an alert indication, Ihe text portion 
that would be formatted for the OCP is sent after establishing 
a modem connection with the indicated number. Note: There 

te nn nttaina ciinrwtrt TAPT AlnflATIIllTieric Or Numeric 

implied by this option. 


CLI_PASSWORD 


The only password that is allowed to at time 
of connection. A password prompt is used. 


The password prompt appears on a modem connection 
requesting the password entry to continue. The entry must 
match the null terminated string belonging to this knob. If 
not, a hang-up command is sent to the modem. A default 
password will exist <TBD> , if none has been assigned. 



Modem Knobs 



Fig. 80 







Proxy Forwarding 


LAN messages to the CMM fail. 


CMM presence watchdog 


There is no notification of failure 


TFTP Server 


CMM is unable to be firmware upgraded 


Error repository & distribution 


CMM is unable to log errors 


Power hierarchy 


Partition power changes cannot occur 


Time Services 


CMM does not receive regular time updates 


Virtual Console Terminal 


Console input/output unavailable if primary in path 


SRM Env. Var. Repository 


Env. Writes fail; SRM write callbacks fail. 
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few* 
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Distribute Partition Database with EV7 change, 
Add EV7, Delete EV7 


T 


T 


T 


Provided the new EV7 is still in the 
majority group and routable. 


Set Partition Delta Time, Store Environment 
Variables, Assign Sub partitions, Assign Memory 
&I07 


X 


X 


T 


This affects the database; but when 
joined back again majority wins. 


Reset, Halt, Quiesce, Continue 


T 


T 


X 


This doesn't affect the non-volatile 
database. 


Power On, Power Off, Change Primary 


X 


X 


X 


Never allowed on a split partition 



Operation Limitations in a degraded system 
Fig. 82 




The LAN Group protocol messages use either broadcast or 
request/response messages in forming a group. 


GroupId(RAM), 
MajGID(RAM), Micro- 
procesorSet(NVRAM) 


NewGroup, Accept, Join, 
SetMembership 


X 


X 


The Group Leader, after forming a new group, checks the 
copy of all members* partition databases and distributes the 
copy. EV7 changes noted by the PMU Server are distributed 
via a partition database change. The partition coordinator, 
when reconfiguring the partition, may need to distribute 
commands that change the volatile copy of the partition 
database. 


EV7/I07, memory 
locations, assignments 
and status. 


Request partition 
database, Distribute 
partition database 


X 


X 


The PMU Server initialization includes the cable testing and 
distribution of that volatile database information 


Cable Configuration 


Retrieve Cabling 
Configuration 


X(not 
distribu 
ted) 




The DHCP Server distributes the list of DHCP leases and 
their changes. 


DHCP Leases 


Distribute DHCP Lease 
Data 


X 


X 


The Partition Coordinator distributes to all members any 

«*tian»*c in tht* cratiic nf Hip nartirinn*c <»fa fe and attributes to 

■ CQaXUSCS 111 UC Ma HI It Ul lilt UAl uuuu a aiaiw cimi oui k\*\*%*rt ■** 

allow fail-over recovery to another partition coordinator. 
Changes to Memory, 107 and Community assignments among 
th* ciih-nnrririnrK Partition states are affected bv the oncoins 
starting, routing, loading, halting, resetting and power 
controls on the entire partition. Attribute fields on a partition 
are: 1) OS Watchdog Interval and Action Mask, 2) BB_Watch 
Delta Time, 3) SRM Environment Variables. 


Partition State and 
attribute Melds(RAM). 
The state and OS 
Watchdog is kept in 
volatile RAM and all 
other attributes are stored 
in NVRAM location for 
that partition. 


Set Partition State and 
attributes or Distribute 
One Partition's Database 


X 


X 


MBM maintains in RAM status on it's own CMMs, EV7s and 
memory. I2C data, error log count, Knobs and OCP data is 
maintained in RAM. 


CMM EV7 Status, EC 
sensor and EEROM 
values, volatile Knobs. 


MBM Report 
Configuration 


X(not 
distibut 
cd) 




MBM maintains the current use of the OCP switch settings 
and some Knobs. Default is entire system enclosure. 


OCP switch control, 
permanent Knobs. 


OCP to Partition 
Assignment 


X(not 
distribu 
ted) 


X(not 
distribu 
ted) 


PBM maintains a RAM copy of it's own 107 Ids, I2C data 
and error log count. 


107 riser Ids, I2C sensor 
and EEROM values. 


PBM Report 
Configuration, Receive 
Cable ID 


X(not 
distribu 
ted) 




PBM receives from SRM the PCI Configuration Data and 
retrieves it on request. MBM, PBM and CMM knob data are 
kept in NVRAM to tailor behavior. 


PCI Config Space(RAM), 
Knob Data. 


Store PCI Slot Info, Read 
PCI Slot Info, Set Knob 
Data, Get Knob Data 


X(not 
distribu 
ted) 


X(not 
distribu 
ted) 



Data Base Grouping 
Fig. 83 



84.000 



84,002 



IN FLASH 



NON-VOLATILE PARTITION DB 



HIS E/yy_ _HARD_ 
" 0 " 0 7 
• 

x y z 
x : 0-15 y : 0-15 z: 0-255 
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